Maximum information stratification method for controlling item exposure in computerized adaptive testing.

نویسندگان

  • Juan Ramón Barrada
  • Paloma Mazuela
  • Julio Olea
چکیده

The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters ( a ) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rates of the items is less skewed, while efficiency is maintained in trait-level estimation. The pseudo-guessing parameter ( c ), present in the three-parameter logistic model, is considered irrelevant, and is not used in the AS method. The Maximum Information Stratified (MIS) model incorporates the c parameter in the stratification of the bank and in the item-selection rule, improving accuracy by comparison with the AS, for item banks with a and b parameters correlated and uncorrelated. For both kinds of banks, the blocking b methods (Chang, Qian and Ying, 2001) improve the security of the item bank.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing

While computerized adaptive tests have enjoyed tremendous growth in the past decade, satisfactory solutions for many important problems are still unavailable. Among these problems, a critical one is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they tend to choose items with high discriminating power. Thus, these items are selected far more...

متن کامل

A Gradual Maximum Information Ratio Approach to Item Selection in Computerized Adaptive Testing

For long-term quality control of computerized adaptive test (CAT) programs, optimizing the usage of the item bank (i.e., controlling item exposure rate) is critical. Selecting the best item often conflicts with the procedure for item exposure control, however. In this study, a newly proposed approach to item selection in CAT, in which the efficiency of items is considered in the early stages of...

متن کامل

Comparison of methods for controlling maximum exposure rates in computerized adaptive testing.

This paper has two objectives: (a) to provide a clear description of three methods for controlling the maximum exposure rate in computerized adaptive testing -the Symson-Hetter method, the restricted method, and the item-eligibility method- showing how all three can be interpreted as methods for constructing the variable sub-bank of items from which each examinee receives the items in his or he...

متن کامل

Non–Fisher-Information Item Selection Criteria 1 Running head: Non–Fisher-Information Item Selection Criteria Comparison of Non–Fisher-Information Item Selection Criteria in Fixed-Length Computerized Adaptive Testing

The maximized Fisher information (MFI) criterion has been the mainstream of the item selection algorithm in many computerized adaptive test (CAT) programs because of its effectiveness and simplicity. There are still several issues with the MFI criterion, however, that need to be resolved in the field, specifically regarding estimation accuracy at the beginning of CAT administration and item poo...

متن کامل

Content Balancing in Stratified Computerized Adaptive Testing Designs

For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Psicothema

دوره 18 1  شماره 

صفحات  -

تاریخ انتشار 2006